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ABSTRACT 


Objective: We aimed to evaluate the research and publication trends on the coronavirus 
disease (COVID-19) vaccine, and so guide future studies. 


Materials and Methods: A bibliometric analysis was performed using a VOSviewer 
visualization methodology. Information about publications Web of Science database 
outputs, countries, institutions, journals, keywords, and citation counts was retrieved. 


Results: A total of 929 eligible publications from January 1, 2020, to February 28, 2021, were 
derived from the WOS database according to the search criteria. Publications were written 
in nine languages, mainly in English (96.7%). From these results, a total of 300 articles were 
reached by filtering. The average number of citations was found to be 7.73. The H-index 
of the articles, which were cited 2320 times in total, was 22. Most of the publications were 
articles (32.29%) and editorials (28.09%). There were 73 different research areas, mostly in 
general internal medicine (26.6%) and immunology (19.05%). The United States of America 
produced the majority of articles (31.32%). 


Conclusion: This bibliometric analysis presents that publications on the COVID-19 vaccine 
are rapidly changing at a time when exactly the effective vaccines of COVID-19 have not 
been discovered yet. 
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INTRODUCTION 


oronavirus disease 2019 (COVID-19) was declined as a pandemic by the World 

Health Organization (WHO) in March 2020. The initial diagnosis of the disease was 

made in a very complex process. In addition to treating and preventing its spread, 
vaccination studies have been started rapidly (1). Since January 24, 2020, the University 
of Queensland in Australia started the COVID-19 vaccine development study, many vac- 
cine studies, including our country, continue globally (1, 2). In February 2020, the WHO 
announced that it does not expect a vaccine against SARS-CoV-2 to be available in less 
than 18 months (3). 
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Continuation of the pandemic without slowing 
down, increasing mortality and morbidity rates led 
to the global application of rapid vaccination (1, 2). 
The United States Food and Drug Administration 
(FDA) approved the emergency use of the vaccine 
on December 11, while the European Medicines 
Agency (EMA) approved its use in member coun- 
tries on December 21. The Pfizer-BioNTech vaccine 
was first administered in England on December 8, 
New York on December 14, and European countries 
on December 27. As of December 27, 2020, 4231 
vaccine candidates were still under development in 
European countries (4). By the time April 8, 2021, 
there were 231 ongoing vaccine studies (5). 


With the declaration of COVID-19 as a pandemic, 
the state of global panic was also reflected in this 
scientific literature. Many articles from all fields re- 
lated to COVID-19 began to be published globally; 
some were related to the vaccine even though there 
was not a COVID-19 vaccine yet. We aimed to eval- 
uate how the developments on COVID-19 vaccines 
were reflected in scientific publications. 


Data were retrieved from the Science Citation In- 
dex-Expanded (SCI-E) of the Web of Science (WOS) 
database (6). In addition, comprehensive bibliomet- 
ric data and the SCI-Expanded, SSCI, A&HCI, and 
ESCI citation index database were retrieved from 
the Web of Science (WOS) Core Collection, which is 
considered as the optimum database for bibliomet- 
rics (7). 


Search Strategy 

The dataset from January 1, 2020, to February 28, 
2021, was obtained from the WOS Core Collection. 
The selected keywords to be used in the WOS search 


HIGHLIGHTS 


e The publications on the COVID-19 vaccine are in- 
creasing rapidly globally. 


e The United States of America ranked in the first 
place about for publications on the COVID-19 
vaccine. 


e The publications on the COVID-19 vaccine have 
high citing rates. 
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engine were “Corona OR Corona virus OR Corona- 
virus OR COVID-19 OR CoV OR nCoV OR SARS OR 
SARS-COV-2’ and ‘vaccine OR vaccination’. In ad- 
dition, “Language = English AND Document type 
= All” were included in the study. The information 
about publications, including research orientation, 
institutions, and funding, was ameliorated by the 
data in the WOS. 


Data Collection 

The titles, years of publication, names of authors, 
nationalities, affiliations, keywords, names of 
publishing journals, abstracts of each record, and 
citations within the publications downloaded from 
WOS, were saved as TXT files and imported into 
Microsoft Office Excel 2019 (Los Angeles, CA, USA). 
We used Ganakkale Onsekiz Mart University's online 
library and digital resources to access information. 


Bibliometric and Visualized Analysis 


The bibliometric analysis takes advantage of bib- 
liometric theory to analyze pertinent literature 
through mathematical and statistical approach- 
es, which has become an important tool for global 
analysis and investigation in various scientific ar- 
eas (8, 9). 


Basic characteristics of eligible publications, which 
were mentioned previously, were described through 
the intrinsic function of WOS. The Hirsch (H)-in- 
dex was regarded as an optimum measurement to 
evaluate the impact of scientific research and was 
proposed as an alternative to other bibliometric in- 
dicators (10). 


The H-index and the impact factor (IF) of the pub- 
lishing journal were considered indicators of the 
impact of publications (8, 11). 


Analytical Methods 

Retrieved data were analyzed to present various 
bibliometric indicators, while maps were visualized 
using the visualization of similarities (VOS) 
viewer technique. We used VOSviewer (version 
1.6.16; Leiden University Center for Science and 
Technology Studies, Leiden, Netherlands) for the 
visualized analysis of the publications, including 
bibliographic coupling, co-authorship, co-citation, 
and co-occurrence analysis (8, 9, 11). 
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Ethical Consideration 

No ethical approval was required in bibliometric 
type studies as there is no human and animal 
involvement. 


RESULTS 


Analysis of Global Publications 

According to the search criteria, a total of 929 eligible 
publications from January 1, 2020, to February 
28, 2021, were derived from the WOS database. 
Publications were written in nine languages, mainly 
in English (96.7%). 


H-Index Numbers 

The average number of citations of these 929 
publications was found to be 5.99. The H-index was 
found to be 33, which were cited 5568 times totally. 


Citation Numbers 

From these results, a total of 300 articles were 
reached by filtering. The average number of 
citations for the articles was found to be 7.73. The 
H-index of these articles, which were cited 2320 
times in total, was 22. 


Publications Features 

When we examined the features of the publications, 
we found that the most were articles (32.29%) and 
editorials (28.09%) (Table 1). 


According to the examination of research areas, 
there were 73 different areas, mostly in general in- 
ternal medicine (26.6%) and immunology (19.05%). 
The main research areas of publications are given 
in Table 2. 


Publications were from 97 different countries. The 
United States of America produced the majority of 
articles (31.32%), followed by the United Kingdom 
(9.90%) and India (8.93%). Fifteen countries with the 
highest number of publications are given in Table 3. 


The WHO was the most cited author (Table 4). Vac- 
cine, The Lancet, and The New England Journal of 
Medicine were the most cited journals; total link 
strength (TLS) was listed accordingly (Table 5). The 
USA was cited 2090, China 1032, Norway 653, En- 
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Table 1. Types of documents. 


n=929 (%) 
Original Article 300 (32.29) 
Editorial 261 (28.09) 
Review 145 (15.60) 
News item 128 (13.77) 
Early access 91 (9.79) 
Letter 79 (8.50) 
Other 18 (1.93) 


Table 2. Research domain of documents. 


n=929 (%) 
General internal medicine 247 (26.58) 
Immunology 17 (19.05) 
Research experimental medicine 108 (11.62) 
Science & technology - Other topics 84 (9.04) 
He environmental and occupational 68 (7.32) 
Pharmacy and pharmacology 62 (6.67) 
Applied microbiology and biotechnology 61 (6.56) 
Infectious diseases 41 (4.41) 
Microbiology 37 (3.98) 
Chemistry 35 (3.76) 
Biochemistry and molecular biology 29 (3.12) 
Pediatrics 26 (2.79) 
Healthcare sciences & services 24 (2.58) 
Virology 22 (2.36) 
Engineering 19 (2.04) 


gland 522, and Thailand 433 times. The bigger the 
rectangle, the more citation the country has. There 
are four clusters formed; red color indicates clus- 
ter 1 (90 sources), green color indicates cluster 
2 (57 sources), the blue color indicates cluster 3 
(31 sources), yellow color represents cluster 4 (21 
sources) (Figure 1, 2). 
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Table 3. Summary of the highest number of publications 


Table 5. Top 15 journals with the most citations. 


according to countries. ; 
es Total link 
a —EeEeeses Source Citations 
strength 
Countries/Regions n=929 (%) 
Vaccine 1027 45,895 
USA 2911 (31.22) The Lancet 942 46,597 
England 92 (9.90 
g ) The New England Journal 775 40,280 
; of Medicine 
India 83 (8.93) 
Nature 766 45,241 
The People’s Republic 
of China ea Science 714 40,983 
Italy 46 (4.95) Journal of Virology 612 48,055 
Germany 43 (4.63) JAMA The Journal of the American 437 17.113 
Medical Association : 
Conada an he0) Proceedings of the National 
: Academy of Sciences ie annee 
Australia 33 (3.55) ud 
Saudi Arabia 22 (2.37) cel ~ ci 
Switzerland 22 (2.37) ddiiacled a? bic 
Turkey 22 (2.37) The Lancet Infectious Diseases 294 16,782 
seatue 19 (2.05 The Journal of Infectious Diseases 263 14,772 
Human Vaccines & 
Netherlands 19 (2.05) Immunotherapeutics ae Bee 
South Africa 19 (2.05) Journal of Medical Virology 258 15,885 
Iran 17 (1.83) British Medical Journal 250 6863 
Table 4. Top 15 cited authors. Sos er 
The minimum number of citations of a source was 
athGr Citations ae set at 20. Of the total sources, only 217 sources 
gt meet the threshold. The Journal of Virology was the 
World Health Organization 528 5345 leading source with highest total link strength (TLS) 
Zhu, FC ro a 99,906 (citations = 1305), followed by Vaccine (TLS = 
79,988, citations = 1369), and Nature (TLS = 77,098, 
Du, LY 100 2375 ee . 

n citations = 1167). Huang Cl (82 times), Zhou P (71 
Folegatti, PM 94 1601 times) and Le TT (69 times) were the most cited au- 
Gériers orbeaselcaatial mo ie thors. Larger circles have slightly more references. 
and Prevention The co-citation and cited sources visualization map 
Huang, CL 82 1354 is presented in Figure 3 and Figure 4. 

Jiang, SB 82 1579 
DISCUSSION 
Le, TT 79 963 
Walls, AC 73 1330 Since COVID-19 was declared a pandemic, the rap- 
Zhou, P 7 4211 idly increasing number of cases also accelerated 
vaccine development work. Results provide a com- 
Wu, F 71 1238 ; - 
prehensive overview of the COVID -19 pandemic in 
Lurie, N 70 756 the 46 countries leading in research. 
Jackson, LA 66 1033 
Many databases such as; EBSCO, Scopus, Pro-Quest, 
Mahase, E 66 413 . mar a ae 
PubMed, Science Direct can be used for bibliomet- 
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Figure 1. The density map of the keywords of the publications that are repeated at least three times about the COVID-19 vaccine. The 
words represented by the larger circle size are relatively more common. Lines connecting words are indicative of keywords that are 
together. There are relatively more words represented by larger circle size or font size. 


ric analyses. When the Pubmed database was ex- 
amined, it was found that there were 173 COVID-19 
related bibliometric analyzes. Only five of them 
used the WOS database (12-17). We used the WOS 
database, too, as it has the highest quality indexing 
journals. 


A bibliometric analysis study, which was exam- 
ined the publications on COVID-19, conducted by 
Oliveira et al. (12) in the early pandemic (publica- 
tions up to May 11, 2020, have been reviewed), de- 
termined that most of the publications were made 
from China. However, we determined that most of 
the publications were made from the USA. Similar 
to our results, in the study conducted by Wang et al. 
(13), most publications were made from the USA. 
This situation can be attributed to the fact that 
the pandemic had started in China, but the num- 
ber of cases decreased rapidly there, and then the 


USA became the country with the highest number 
of cases. Our study supports this result; although 
the first research and published literature had been 
from China, China later ranked fourth in the coun- 
tries’ ranking. USA, England, and India were the 
most productive countries. Most of the publications 
in previous studies were reviews and letters to ed- 
itors, but in our study conducted in 2021, most of 
the publications were found to be articles (12-16). 


The Lancet, Journal of Medical Virology and British 
Medical Journal (BMJ) were the most cited journals 
in previous studies (12-16). However, according to 
our study, Vaccine, The Lancet, and The New En- 
gland Journal of Medicine journals had the most 
citations. This can result from their being globally 
high-impact journals and having open calls for arti- 
cles on the COVID-19 vaccine topic. 
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Figure 2. Citation map by countries. Fifty-three countries out of 72 have at least one reference. The number of those 
who referred to each other is 46. 
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Figure 3. Co-citation map of publications on COVID-19 vaccine by references. 
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Figure 4. Co-citation map of publications on COVID-19 vaccine by keywords. 


General Internal Medicine, Immunology, and Re- 
search Experimental Medicine were the most com- 
mon research areas, and a similar trend was ob- 
served in WOS categories. 


With 5345 citations in WOS, the WHO had the 
greatest within the published papers. Since the in- 
stitution is expected to provide the most accurate 
and general information about COVID-19 infection 
and vaccines globally, the number of citations to be 
so high was accepted as normal. 


Furthermore, visualization mapping shows that 
COVID-19 and the SARS-CoV-2 was the most co-oc- 
currence author keyword. Although significant 
progress had been made in vaccine development, 
challenges remained. There were still uncertainties 
about the effectiveness of the vaccines. This situ- 
ation was reflected especially in scientific studies. 
There were thousands of documents on COVID-19 
and around ten thousand publications on the 
COVID-19 vaccine. 


Before conducting this study, we conducted a liter- 
ature review on COVID-19 and bibliometric analy- 
sis and included 170 articles. Anmad et al. (16) con- 
ducted a similar study in January 2021; they used 
the WOS database, also HistCite TM and VOSviewer 
for visualization . Nine hundred sixteen documents 
were evaluated. After that study, which was con- 
ducted about one month before our study, nine 
more articles were added to the literature. In that 
study, Human Vaccines & Immunotherapeutics 
was the top-cited journal, but it was Vaccine journal 
in our study. This situation showed that the studies 
on COVID-19 and vaccines were rapidly changing. 
Over time number of papers on the COVID-19 vac- 
cine has been increased. 


Our study evaluated the global research trend in 
the COVID-19 vaccine and provided detailed infor- 
mation about published literature on the COVID-19 
vaccine, in addition to constructing visualization 
network mapping for co-authorship and country, 
co-occurrence and author keywords, and co-cita- 
tion and cited sources. 
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The current study has several limitations. Because 
studies in journals that were not scanned in the 
WOS index could not be evaluated and analyzed. 
Keywords were only in English, so publications 
written in other languages might be omitted. Other 


databases (i.e., Scopus) were not included in the re- 
search. Analyses were made only by the VOSviewer. 
Other software (i.e., CiteSpace I] and BibExcel) can 
be used in future studies. 
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